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Abstract 

This paper considers the controUabiUty problem for multi-agent systems. In particular, the structural 
O ' controllability of multi-agent systems under switching topologies is investigated. The structural control- 

lability of multi-agent systems is a generalization of the traditional controllability concept for dynamical 
^ . systems, and purely based on the communication topologies among agents. The main contributions of 

m 

QQ ■ the paper are graph-theoretic characterizations of the structural controllability for multi-agent systems. 

in 
in 

ff^ ' if the union graph Q of the underlying communication topologies is connected (single leader) or leader- 

o 

fvq . follower connected (multi-leader). Finally, the paper concludes with several illustrative examples and 

discussions of the results and future work. 
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^1 I. Introduction 

Due to the latest advances in communication and computation, the distributed control and 
coordination of the networked dynamic agents has rapidly emerged as a hot multidisciplinary 
research area QLawton et al, 20021 [Dunbar et al, 2006||Bliman et al, 2008| |, which lies at the 



It turns out that the multi-agent system with switching topology is structurally controllable if and only 



intersection of systems control theory, communication and mathematics. In addition, the advances 
of the research in multi-agent systems are strongly supported by their promising civilian and 
military applications, such as cooperative control of unmanned air vehicles(UAVs), autonomous 
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underwater vehicles(AUVs), space exploration, congestion control in communication networks, 
air traffic control and so on pTomlin et ah, 1998| [ |How et ah, 20041 . Much work has been done 



on the formation stabilization and consensus seeking. Approaches like graph Laplacians for 
the associated neighborhood graphs, artificial potential functions, and navigation functions for 
distributed formation stabilization with collision avoidance constraints have been developed. 
Furthermore, inspired by the cooperative behavior of natural swarms, such as bee flocking, ant 
colonies and fish schooling, people try to obtain experiences from how the group units make 
their whole group motions under control just through limited and local interactions among them. 

The control of such large scale complex systems poses several new challenges that fall beyond 
the traditional methods. Part of the difficulty comes from the fact that the global behavior of 
the whole group combined by multiple agents is not a simple summation of the individual 
agent's behavior. Actually, the group behavior can be greatly impacted by the communication 
protocols or interconnection topology between the agents, which makes the global behavior 
display high complexities. Hence, the cooperative control of multi-agent systems is still in its 
infancy and attracts more and more researchers' attention. One basic question in multi-agent 
systems that attracts control engineers' interest is what is the necessary information exchanging 
among agents to make the whole group well-behaved, e.g., controllable. This can be formulated as 
a controllability problem for multi-agent systems under the leader-follower framework. Roughly 
speaking, a multi-agent system is controllable if and only if we can drive the whole group 
of agents to any desirable configurations only based on local interactions between agents and 
possibly some limited commands to a few agents that serve as leaders. The basic issue is the 
interplay between control and communication. In particular, we would like to investigate what 
is the necessary and/or sufficient condition on the graph of communication topologies among 
agents for the controllability of multi-agent systems. 

This multi-agent controllability problem was first proposed in [Tanner, 2004| , which formu- 



lated it as the controllability of a linear system and proposed a necessary and sufficient algebraic 
condition based on the eigenvectors of the graph Laplacian. Reference |Tanner, 2004| focused on 



fixed topology situation with a particular member which acted as the single leader. The problem 
was then developed in flJi et al, 20061 |Ji et al., 2007| [ [Rahmani et al., 2006[ | 



[Ji et al, 2008] , and got some interesting results. For example, in QJi et ah, 2007[ |, it was shown 



that a necessary and sufficient condition for controllability is not sharing any common eigenvalues 
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between the Laplacian matrix of the follower set and the Laplacian matrix of the whole topology. 
However, it remains elusive on what exactly the graphical meaning of these algebraic conditions 
related to the Laplacian matrix. This motivates several research activities on illuminating the 
controllability of multi-agent systems from a graph theoretical point of view. For example, 
a notion of anchored systems was introduced in QRahmani et al. , 2006| | and it was shown that 
symmetry with respect to the anchored vertices makes the system uncontrollable. However, so far 
the research progress using graph theory is quite limited and a satisfactory graphical interpretation 
of these algebraic controllability conditions turns out to be very challenging. Besides, the weights 
of communication linkages among agents have been demonstrated to have a great influence 



on the behavior of whole multi-agent group (see QMoreau, 2005| as an example). However, 
in the previous multi-agent controllability literature Planner, 20041 -[ |R"ahmani et ah, 2006| , the 
communication weighting factor is usually ignored. One classical result under this no weighting 
assumption is that a multi-agent system with complete graphical communication topology is 



uncontrollable QTanner, 20041 . This is counter- intuitive since it means each agent can get direct 



information from each other but this leads to a bad global behavior as a team. This shows that too 
much information exchange may damage the controllability of multi-agent system. In contrast, 
if we set weights of unnecessary connections to be zero and impose appropriate weights to other 
connections so as to use the communication information in a selective way, then it is possible 



to make the system controllable QZamani et al., 2009| 



In this paper, motivated by the above observation, the weighting factor is taken into ac- 
count for multi-agent controllability problem. In particular, a new notion for the controlla- 
bility of multi-agent systems, called structural controllability, which was proposed by us in 
[Zamani et ah, 2009| , is investigated directly through the graph-theoretic approach for control 



systems. The communication topology of whole multi-agent system is described by a weighted 
graph and the system is called structurally controllable if one may find a set of weights such 
that the corresponding multi-agent system is controllable in a classical sense. The structural 
controllability reveals under certain topology whether it is possible to make the whole multi- 
agent system well-behaved, i.e. controllable here through suitable choice of the communica- 
tion weights. From another angle, it helps to bring to light the effects of the communication 
topology on the controllability property of multi-agent systems without worrying about the 
influence of weighting factors. It turns out that this controllability notation only depends on 
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the topology of the communication scheme in the case of a single leader under a fixed topology 
^Zammi etal, 2009| . 



Another novelty in this paper is the successful investigation of impacts of switching topologies 
on the multi-agent controllability property, for which there is barely graphical interpretation to 
the best of our knowledge. Note that the resuks in QTanner, 20041111 et al, 2006| ilTg? al, 2007 1 



QRahmani et ah, 20061 [ |Ji st ah, 2008| QZamani et ah, 2009| are all focused on multi- agent sys 



tems under fixed communication topologies which may restrict their impacts on real applications. 
In many applications, it may become impossible to keep the communication topology fixed for 
the whole period. Therefore, it is of practical importance to consider time varying communication 
topologies. A natural framework to study the time variance of communication topology is through 
switched systems, see e.g., [ [Lin et al, 2007] [ |Lin et al, 2009[ |[ [Sun et al, 20021 . In this paper. 



we will focus on multi-agent systems under switching topologies in the framework of switched 
systems. Some early efforts have been observed in the literature. Necessary and sufficient al- 
gebraic conditions for the controllability of multi-agent systems under switching topology were 
derived in [ [Ji et al, 20081 [ [Uu et al, 20081 based on the developments of controllability study 



in switched systems. However, these algebraic results lacks graphically intuitive interpretations, 
which are important since they can provide us significant guidelines for the communication 
protocol design for multi-agent systems. Therefore, this paper aims to fill this gap and propose 
graphic interpretations of these algebraic conditions for the controllability of multi-agent sys- 
tems under switching topology. In particular, we follow the setup in flZamani et al., 20091 and 



investigate the structural controllability of multi-agent systems with switching communication 
topologies and for both single leader and multi-leader cases. It is assumed that the leaders act 
as the extemal or control signal and will not be affected by any other group members. Based 
on this structural controllability, we propose necessary and sufficient graph theoretic conditions 
for the structural controllability of multi-agent system with switching topologies. It turns out 
that the multi-agent system with switching topology is structurally controllable if and only if 
the union graph Q of the underlying communication topologies is connected (single leader) or 
leader-follower connected (multi-leader). Some examples are given to underscore our theoretical 
analysis. 

The outline of this paper is as follows: In Section II, we introduce some basic preliminaries 
and the problem formulation, followed by structural controllability study in Section III, where 
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a graphic necessary and sufficient condition for the structural controllability under single leader 
case is given. In Section IV, graphical interpretation of structural controllability of multi-leader 
multi-agent system is proposed. In Section V, some examples are presented to give the readers 
deeper understanding of our theoretical results. Finally, some concluding remarks are drawn in 
the paper. 

II. Preliminaries and Problem Formulation 

A. Graph Theory Preliminaries 

A weighted graph is an appropriate representation for the communication or sensing links 
among agents because it can represent both existence and strength of these links among agents. 
The weighted graph Q with A^ vertices consists of a vertex set 'V = {vi, V2, . . . , v^} and an edge 
set I = {ei,e2, ■ ■ ■,eN'}, which is the interconnection links among the vertices. Each edge in 
the weighted graph represents a bidirectional communication or sensing media. Two vertices are 
known to be neighbors if (z, j) e I, and the number of neighbors for each vertex is its valency. 
An alternating sequence of distinct vertices and edges in the weighted graph is called a path. 
The weighted graph is said to be connected if there exists at least one path between any distinct 
vertices, and complete if all vertices are neighbors to each other. 

The adjacency matrix, J{ is defined as 

I otherwise, 
where 'Wij 4^ stands for the weight of edge (j, /). Here, the adjacency matrix J?l is | "V | x | "V | 
and I . I is the cardinality of a set. 

The Laplacian matrix of a graph Q, denoted as £.{Q) e Rl^'^l^l^l or X for simplicity, is defined 
as ^ 

^jeN, "Wij i = j, 

AiJ) = \ -^ij i * j <^nd (i, j) e I, (2) 

otherwise. 

B. Multi-agent Structural Controllability with Switching Topology 

Specifically, controllability problem usually cares about how to control A^ agents based on the 
leader-follower framework. Take the case of single leader as example. Without loss of generality, 
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assume that the A'^-th agent serves as the leader and takes commands and controls from outside 
operators directly, while the rest N - I agents are followers and take controls as the nearest 
neighbor law. 

Mathematically, each agent's dynamics can be seen as a point mass and follows 



■^i ~ W,-. 



(3) 



The control strategy for driving all follower agents is 

where Ni is the neighbor set of the agent / (could contain / itself), and Wij is weight of the edge 
from agent j to agent /. On the other hand, the leader's control signal is not influenced by the 
followers and needs to be designed, which can be represented by 



X]\[ — M/v 



(5) 



In other words, the leader affects its nearby agents, but it does not get directly affected by 
the followers since it only accepts the control input from an outside operator. For simplicity, we 
will use z to stand for x^ in the sequel. It is known that the whole multi-agent system under 
fixed communication topology can be written as a linear system: 

(6) 

where A e ]^(n-i)x(n-\) ^^^ g ^ ^(n-i)xi ^g |^qj|^ sub-matrices of the corresponding graph 
Laplacian matrix -X 

The communication network of dynamic agents with directed information flow under link 
failure and creation can usually described by switching topology. Under m switching topologies, 
it is clear that the whole system equipped with m subsystems can be written in a compact form 



X 




A B 


X 


+ 





z 







z 




UN 



X 




A,- 


5, 


X 


-1- 















7 




Un 



or, equivalently. 



X 

z 



AiX + BiZ, 

Un, 



(7) 



(8) 
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where i e {1, . . . , m}. A,- e ]r(A'-i)x(A'-i) and 5,- e M^'^"^^^^ are both sub-matrices of the correspond- 
ing graph Laplacian matrix -£.. The matrix A, reflects the interconnection among followers, and 
the column vector 5, represents the relation between followers and the leader under corresponding 
subsystems. Since the communication topologies among agents are time-varying, so the matrices 
Aj and 5, are also varying as a function of time. Therefore, the dynamical system described in 
(|7]) can be naturally modeled as a switched system (definition can be found latter). 

Considering the structural controllability of multi-agent system, system matrices A, and 5,, 
i e {1, . . . , m} are structured matrices, which means that their elements are either fixed zeros or 
free parameters. Fixed zeros imply that there is no communication link between the corresponding 
agents and the free parameters stand for the weights of the communication links. Our main task 
here is to find out under what kinds of communication topologies, it is possible to make the group 
motions under control and steer the agents to the specific geometric positions or formation as a 
whole group. Now this controllability problem reduces to whether we can find a set of weights 
Wij such that the multi-agent system ^ is controllable. Then the controllability problem of 
multi-agent system can now be formulated as the structural controllability problem of switched 
linear system (|7]): 

Definition 1: The multi-agent system (|7]) with switching topology, whose matrix elements are 
zeros or undetermined parameters, is said to be structurally controllable if and only if there exist 
a set of communication weights wtj that can make the system (|7]) controllable in the classical 
sense. 

C. Switched Linear System and Controllability Matrix 

In general, a switched linear system is composed of a family of subsystems and a rule that 
govems the switching among them, and is mathematically described by 

x(t) = A^^t^xit) + B^<t)U{t), (9) 



A 



where x{t) 6 M" are the states, u{t) 6 W, are piecewise continuous input, a : [fo, oo) ^> M 
{1, . . . , m} is the switching signal. System Q contains m subsystems (A,, 5,), z e {1, . . . , m} and 
o-{t)= i implies that the /th subsystem (A,, 5,) is activated at time instance t 

For the controllability problem of switched linear systems, a well-known matrix rank condition 
was given in [ |Sun et al. , 2004| : 
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Lemma 1: ( [Sun et ah, 2004| ) If matrix: 



[iji, . . . , Bfy„A\B\, . . . ,A,„B[, . . . ,A,„B^,A^Bi, . . . ,A^A[Bi, 

. . . ,A^B,n, . . . ,A,„AiB,„, . . .,A" Bi, . . .,AmA1 B\,..., (10) 

A,A"~^R A"~^R 1 

has full row rank n, then switched linear system <^ is controllable, and vice versa. 

This matrix is called the controllability matrix of the corresponding switched linear system 

m. 

III. Structural Controllability of Multi- agent System with Single Leader 

The multi-agent system with a single leader under switching topology has been modeled as 
switched linear system (|7]). Before proceeding to the structural controllability study, we first 
discuss the controllability of multi-agent system (|7]) when all the communication weights are 
fixed. 

After simple calculation, the controllability matrix of switched linear system (|7]) can be shown 
to have the following form: 

0, ... ,0, Bi, ..., Bm, AiBi ..., AiA„," 5„„ ..., A,,^" 5„, 

1, ... ,1, 0, 0, 0, 0, 0, 0, 0, 
This implies that the controllability of the system (|7]) coincides with the controllability of the 
following system: 

X = AiX + BjZ i e{l,...,m}. (11) 

Which is the extracted dynamics of the followers that correspond to the x component of the 

equation. Therefore, 

Definition 2: The multi-agent system ([7]) is said to be structurally controllable under leader z 

if system (ITTI) is structurally controllable under control input z. 

For simplicity, we use (A,, 5,) / e {l,...,m} to represent switched linear system dTTT i in the 

sequel. 

In (fTTl) . each subsystem (A,, 5,) can be described by a directed graph QLin, 1974) : 
Definition 3: The representation graph of structured system (A,, 5,) is a directed graph ^;, 

with vertex set "V,- = Xi U "ZY,, where Xi = {x\,X2,..., Xn\, which is called state vertex set and 
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tli = [u\,U2,...,Ur}, which is called input vertex set, and edge set J, = Jf/.^, U -^x,Xp where 
^f/,x, = {{Up, Xq)\B,jp i^O,l<p<r,\<q<n}and Ix,x, = {(Xp, Xy)\A,jp i^O,l<p<n,l<q<n} 
are the oriented edges between inputs and states and between states defined by the interconnection 
matrices A, and 5, above. This directed graph (for notational simplicity, we will use digraph 
to refer to directed graph) ^, is also called the graph of matrix pair (A,, 5,) and denoted by 

For each subsystem, we have got a graph G, with vertex set "Vt and edge set J, to represent 
the underlaying communication topologies. As to the whole switched system, the representing 
graph, which is called union graph, is defined as follows: 

Definition 4: The switched linear system (fTTT ) can be represented by a union digraph, defined 
as a flow structure ff. Mathematically, Q is defined as 

^1 u ^2 u . . . u g,„ = {Ti U ^2 U . . . U T„,; (12) 

Ji U J2 U . . . U J„} 
Remark 1: It turns out that union graph Q is the representation of linear structured system: 

(A1+A2 + ...+ A,n, B1+B2 + ... + BJ. 

Remark 2: In lots of literature about controllability of multi-agent systems [ [Tanner, 2004| - 
QLiu et ah, 2008| , the underlying communication topology among the agents is represented by 



undirected graph, which means that the communication among the agents is bidirectional. Here 
we still adopt this kind of communication topology. Then Wij and Wji are free parameters or zero 
simultaneously (in numerical realization, the values of Wij and wp can be chosen to be diff"erent). 
Besides, one edge in undirected graph can be treated as two oriented edges. Consequently, even 
though all the analysis and proofs for structural controllability of multi-agent systems are based 
on the directed graph (the natural graphic representation of matrix pair (A,, 5,) is digraph), the 
final result will be expressed in undirected graph form. 

Before proceeding further, we need to introduce two definitions which were proposed in 
[ [Lin, 19741 for linear structured system x = Ax + Bu first: 

Definition 5: ([ [Lin, 1974| [) The matrix pair (A, B) is said to be reducible or of form I if there 



exist permutation matrix P such that they can be written in the following form: 

PAP-^ = 



11 





,PB = 





21 


^22 




B22 



(13) 
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where An e Rp^'p , A21 e M("-p)x/', A22 e M(«-p)x("-p) and ^22 e R^''-p'>'"'. 

Remark 3: Whenever the matrix pair (A, B) is of form I, the system is structurally uncontrol- 
lable [Lin, I974I I and meanwhile, the controllability matrix Q = Lb,A5, . . .,A""'5 will have at 



least one row which is identically zero for all parameter values QGlover et ah, 19761 . If there is 
no such permutation matrix P, we say that the matrix pair (A, B) is irreducible. 



Definition 6: ([ |Lin, 1974i |) The matrix pair (A, B) is said to be of form II if there exist 
permutation matrix P such that they can be written in the following form: 



[PAP-\PB\ 



(14) 



where P2 e M("-'^)x(n+r) ^ p^ ^ i^kx(n+r) ^ijj^ j^Q more than k-\ nonzero columns (all the other 
columns of P\ have only fixed zero entries). 

Here we need to recall a known result in literature for structural controllability of multi-agent 
system with fixed topology pZamani et al. , 20091 : 



Lemma 2: The multi-agent system with fixed topology under the communication topology Q 
is structurally controllable if and only if graph Q is connected. 

This lemma proposed an interesting graphic condition for structural controllability in fixed 
topology situation and revealed that the controllability is totally determined by the communication 
topology. However, how about in the switching topology situation? According to lemma [H once 
we impose proper scalars for the parameters of the system matrix (A,, 5,) to satisfy the full rank 
condition, the multi-agent system (fTTI) is structurally controllable. However, this only proposed 
an algebraic condition. Do we still have very good graphic interpretation for the relationship 
between the structural controllability and switching interconnection topologies? The following 
theorem answers this question and gives a graphic necessary and sufficient condition for structural 
controllability under switching topologies. 

Theorem 1: The multi-agent system (fTTI) with the communication topologies Qi,ie[l,...,m} 
is structurally controllable if and only if the union graph Q is connected. 

Proof: Necessity: Assume that the multi-agent switched system is structurally controllable, 
we want to prove that the union graph Q is connected, which is equivalent to that the system 
has no isolated agents in the union graph Q flZamani et ah, 20091 . 
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Suppose that the union graph Q is disconnected and for simplicity, we will prove by contradic- 
tion for the case that there exits only one disconnected agent. The proof can be straightforwardly 
extended to more general cases with more than one disconnected agents. If there is one isolated 
agent in the union graph, there are two possible situations: the isolated agent is the leader or one 
of the followers. On one hand, if the isolated agent is the leader, it follows that B1+B2 + . . . + 3^ 
is identically a null vector. So every 5, is a null vector. Easily we can conclude that the 
controllability matrix for the switched system is never of full row rank N - I, which means 
that the multi-agent system is not structurally controllable. On the other hand, if the isolated 
agent is one follower, we get that the matrix pair (Ai -I- A2 -i- . . . -i- A^, Bi + B2 + . . . + B^) is 
reducible. By definition |5l the controllability matrix 

[B,+B2 + ... + B,„, 

(A1+A2 + ...+ AJ{Bi +B2 + ... + B,„), 

(Ai + A2 + . . . + A,y-\B, +B2 + ... + BJ] 
always has at least one row that is identically zero. Expanding the matrix yields 

[B,+B2 + ...+ Bm, 

A^Bi + A2B1 -I- ... -I- A,„Bi + A1B2 + A2B2 

-I- ... -I- A,nB2 + . . .+ A]_B,„+ A2B,„ ... -I- A,nB,n 



The zero row is identically zero for every parameter. This implies that every component in this 
matrix, such as Bi,AiBj and AfA^'.Br, has the same row always to be zero. As a result, the 
controllability matrix 

[Bi, . . . ,Bm,AiBi, . . . ,AmBi, . . . ,AmBm,AiBi, . . . ,AmA[Bi, 

. . . ,AyB,n, . . . ,A,„A\B,„, . . . , Aj £>!, . . . , A^Aj B\, . . . , 

A\A^ B,f,, . . . ,A^ £),„J 
always has one zero row. Therefore, the multi-agent system (fTTI) is not structurally controllable. 
Until now, we have got the necessity proved. 
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Sufficiency: If the union graph Q is connected, we want to prove that the multi-agent system 
(fTTI) is structurally controllable. 

According to lemma |21 the connectedness of the union graph Q implies that the corresponding 
system (Ai + A2 + A3 + . . . + A,„, 5i + ^2 + ^3 + • • • + ^m) is structurally controllable. Then there 
exist some scalars for the parameters in system matrices that make the controllability matrix 

[5i + B2 + . . . + Bm, 

{A1+A2 + ...+ A,J(5i +B2 + ... + B,„), 

, . . . , 

(Ai + A2 + . . . + A,„f-\By +B2 + ... + B,„)], 
has full row rank N - I. Expanding the matrix, it follows that the matrix 

[B,+B2 + ...+ Bm, 

AiBi + A25i + . . . + A^Bi + Ai52 + A252 

+ . . . + A„,52 + . . . + AiB,n + A2Bm . . . + AmBm 

? • • • ? 

Af-^5i+A2Af-35i + ...+A^25J, 
has full rank N - I. Next, we add some column vectors to the above matrix and get 

{B\ + B2 + . . . + Bm, B2, . . . , Bm, 

Ai5i -l-A25i + ... +A„,Bi +Ai52 + A2B2 + ... +A„,52 

+ . . . + AiB,„ +A2B,„ + . . . + A,„B,„,A2Bi,At,Bi, . . . ,A,„Bi„ 



A^-'B, +A2A^-'B, + ... +Al''Bm,A2A'(-'Bu . . . ,A^^-%„]. 
This matrix still have A^ - 1 linear independent column vectors, so it has full row rank. Next, 
subtract B2, ... ,5m from B1+B2 + . . .+5^; subtract A25i, . . . ,A,„B,„ from Ai5i+A25i-i-. . .+A,„Bm 
and subtract A2A'^'^Bu . . . ,A^-^Bm from A'^-^Bi + AzAf-^fij + . . . +A^~^Bm. Since this column 
fundamental transformation will not change matrix rank, the matrix still has full row rank. Now 
the matrix becomes 
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lB\, . . . , Bfn,A\B\, . . . ,A,„B\, . . . ,A,„B,„,A^Bi, . . . ,A,„A\Bi, 
. . . ,A^Bfyi, . . . ,A,„AiB,„, . . . , Aj Bi, . . . ,AmA^ B\, . . . , 



in— 2 



which is the controllability matrix of system (fTTT) and has full row rank N - I. Therefore, the 
multi-agent system is structurally controllable. ■ 



IV. Structural Controllability of Multi- agent System with Multi- Leader 

In the above discussion, we assume the multi-agent system has totally N agents and the A^-th 
agent serves as the leader and takes commands and controls from outside operators directly, 
while the rest A^ - 1 agents are followers and take controls as the nearest neighbor law. In the 
following part, we will discuss the situation that several agents are chosen as the leaders of the 
whole multi-agent systems, which is actually an extension of single leader case. 

Similar to the single leader case, the multi-agent system with multiple leaders is given by: 

Xj = Ui, i = \, . . . ,N 

(15) 

Xn+J — Un+j, j — !,...,«/ 

where A'^ and ni represent the number of followers and leaders, respectively, x, indicates the state 
of the /th agent, / = \,. . .,N + ni. 

The control strategy m,, i = I, . . . ,N for driving all follower agents is the same as the single 
leader case. The leaders' control signal is still not influenced by the followers and we are allowed 
to pick un+j, j = I,. . . ,ni arbitrarily. For simplicity, we use vector x to stand for the followers' 
states and z to stand for the leaders' states. 

Then the whole multi-agent system equipped with m communication topologies can be written 

in a compact form 

X Ai Bi X 

(16) 



X 




At 


Bi 


X 


+ 





z 










z 




u 



or, equivalently. 



where / e {l,...,m}. A,- e 
graph Laplacian matrix -£.. 



(17) 



X = AiX + BfZ, 
z = u, 
^NxN ^^^ g, g j^Nxrii ^g i^Qj-j^ sub-matrices of the corresponding 
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The dynamics of the followers can be extracted as 

X = AiX + BiZ, ie[l,...,m}. (18) 



Remark 4: Similar with the single leader case, the structural controllability of system (1161) 
coincides with the structural controllability of system (fTSl) . And we say that the multi-agent 
system (fT5l) with switching topology and multi-leader is structurally controllable if and only if 
the switched linear system (fTSl) is structurally controllable with z as the control inputs. 

Before proceeding further, we first discuss the structural controllability of multi-agent systems 
with multi-leader under fixed topology with the following dynamics: 

i = Ax + Bz, (19) 

where A 6 M^^^ and B e M^^"' are both sub-matrices of the graph Laplacian matrix -£,. 
In [Ji et ah, 2008|pT et ah, 2009| , a new graph topology: leader- follower connected topology 



was proposed: 

Definition 7: ([ |Ji et ah, 2008| ) A follower subgraph Qf of the interconnection graph Q is the 
subgraph induced by the follower set "Vj (here is x). Similarly, a leader subgraph Qi is the 
subgraph induced by the leader set "V/ (here is z). 

Denote by Qci ,■■■ ,&c , the connected components in the follower ^y . The definition of leader- 
follower connected topology is as follows: 

Definition 8: ( flJi et ah, 2009| ) The interconnection graph Q of multi-agent system (fT9l) is 



said to be leader-follower connected if for each connected component ^f, of Qf, there exists 
a leader in the leader subgraph Qi, so that there is an edge between this leader and a node in 

Qc,J= i,...,r- 

Based on this new graph topology, we can derive the criterion for structural controllability for 
multi-agent system (fT9l) under fixed topology: 

Theorem 2: The multi-agent system (fT9l ) with multi-leader and fixed topology under the 
communication topology Q is structurally controllable if and only if graph Q is leader-follower 
connected. 

Proof: Necessity: The idea of necessity proof is similar to the proof of lemma 3 in 
|Ji et ai, 20081 . We assume that there exists one connected component Qc,, not connected to 
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the leader subgraph Qi. Define A, and 5, matrices as sub-matrices of A and B, the same as 
the Fi and i?, matrices in lemma 3 of [ |Ji et ah, 2008| . Following the analysis in lemma 3 of 



pi et ah, 2008| , it can be easily got that the controllability matrix of multi-agent system ([T 

is: 

' Bi AiB, A\Bi ..J 



C 



'2o- --- A^l5l 







L>y J\yL>y J\ IJy 



^r^y 



(20) 



Consequently, rank C = row rank C < N. The maximum rank of C is less than N, which implies 
that the corresponding multi-agent system (fT9] ) is not structurally controllable. 

Sufficiency:^^ use the proof of theorem 1 in QJi et ah, 2009| to help us prove the suffi- 
ciency. The communication graph Q consists of several connected components Q'''\ i = 1, . . . , k, 
which can be partitioned into two subgraphs: induced leader subgraph Q^ and induced follower 
subgraph ^^?. For each connected components Q^^\ / = 1, . . . , k, it can be modeled as a linear 
system with its system matrices being sub-matrices of A and B matrices. Following the analysis 



in theorem 1 in flJi et al, 2009| |, we can get the following equation: 



rank C = rank Ci + rank C2 + ■ ■ ■ + rank C^, 



(21) 



where C is the controllability matrix of multi-agent system ([19] ) and C, is the controllability matrix 
of connected component ff^'\ The independence of these connected components guarantees 
the independence of free parameters in the corresponding matrices, which correspond to the 
communication weights of the linkages. Consequently, we have that 

g-rank C = g-rank Ci+ g-rank C2+. . .+ g-rank C^ 

where ^-rank of a structured matrix M is defined to be the maximal rank that M achieves as a 
function of its free parameters. Besides, if in some connected component 0'\ there is more than 
one leaders, we can split it into several connected components with single leader or choose one 
as leader and set all weights of the communication linkages between the followers and other 
leaders to be zero. After doing this, connected component ^^'^ is a connected topology with 
single leader. According to lemma |2l C, has full g-rank, which equals to the number of follower 
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agents in ^'^'K Moreover, there is no common follower agent among the connected components. 
Consequently, g-rank C=N and multi-agent system (fT9l ) is structurally controllable. ■ 

With the above definitions and theorems, we are in the position to present the graphical 
interpretation of structural controllability of multi-agent systems under switching topology with 
multi-leader: 

Theorem 3: The multi-agent system (fT6l) or (ITS]) with the communication topologies ^;, i e 
{1, . . . , m} and multi-leader is structurally controllable if and only if the union graph Q is leader- 
follower connected. 

Proof: As stated in remark [1] the union graph ^ is the representation of the linear system: 
(Ai -I- A2 -I- A3 + . . . + A,„, Bi + B2 + B3 + . . . + B,n). Therefore, the condition that the union graph 
Q is leader-follower connected is equivalent to the condition that linear system (Ai -I- A2 -i- A3 -l- 
. . . -i-A,„, Bi+B2 + Bi, + . . . + B„j) is structurally controllable. Following the proof steps in theorem 
[H this result can get proved. ■ 

V. Numerical Examples 

Next we will give two examples to illustrate the results in this paper and for simplicity, we 
take single leader case as examples. 



1 



1- 



•0 3 




3^ ^0 3' 

(a) "^ ^ ib) 



Fig. 1. Switched network with two subsystems 



We consider here a four-agent network with agent as the leader and with switching topology 
described by the graphs in Fig. l(a)-(b) (the self- loops are not depicted, because it will not 
influence the connectivity). Overlaying the subgraphs together can get the union graph Q of 
this example as shown in Fig. 1(c). It turns out that the union graph of the switched system is 
connected. By theorem [U it is clear that the multi-agent system is structurally controllable. 

Next, the rank condition of this multi-agent system will be checked. 

From Fig. 1, calculating the Laplacian matrix for each subgraph topology, it can be obtained 
that the system matrices of each subsystem are (one thing we should mention here with the 
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control strategy that each agent can use its own state information, the diagonal elements always 
have free parameters, so we can get the following form of sub- matrix of Laplacian matrix) : 



Ai = 



According to lemma \T\ the controllability matrix for this switched linear system is: 
[BuB2,AiBuA2BuAiB2,A2B2,A]BuA2AiBuAiA2Bu 
AlBuA\B2,A2A,B2,AiA2B2,AlB2l 
After simple calculation, we can find three column vectors in the controllability matrix: 



^1 /I4 









A2 


, 5i = 


^6 


;A2 = 


A5 /I3 










^7 


'^lO 










^11 


^8 





, 52 = 











^9 _ 




An 













A4A12 


A, 


5 





! 










^12 




/13/112 



Imposing all the parameters scalar 1, it follows that these three column vectors are linearly 
independent and this controllability matrix has full row rank. Therefore, the multi-agent system 
is structurally controllable. 

In the second example, we still consider a four-agent network with agent as the leader 
and with switching topology described by the graphs in Fig. 2(a)-(b). Overlaying the subgraphs 
together can get the union graph Q of this example shown in Fig. 2(c). It turns out that the 
union graph of the switched system is disconnected, because agent 2 is isolated. According to 
theorem [T] it is clear that the multi-agent system is not structurally controllable. 




1 



3 



•0 3 




(a) ^ " {b) - " (c) 

Fig. 2. Another switched network with two subsystems 

Similarly, the rank condition of this switched linear system needs to be checked to see whether 
it is structurally controllable or not. 

From Fig. 2, calculating the Laplacian matrix for each graphic topology, it is clear that the 
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^1 





^4 




^6 




Aj 





^10 










h 





, 5i = 





;A2 = 





^8 





, 52 = 





^5 





^3 









/111 





^9 




^12 



system matrices of each subsystem are : 



Ai 



Computing the controllability matrix of this example yields the controllability matrix: 

A^ /li/le • • • AtAioAi2 + A^^AiqAu 

... 

A[2 AsAe ■ ■ ■ A[oAi[Ai2 + A^A[2 
This matrix has the second row always to be zero for all the parameter values, which makes the 
maximum rank of this matrix less than 3. Therefore, this multi-agent system is not structurally 
controllable. 



VI. Conclusions and Future Work 

In this paper, the structural controllability problem of the multi-agent systems interconnected 
via a switching weighted topology has been considered. Based on known results in the lit- 
erature of switched systems and graph theory, graphic necessary and sufficient conditions for 
the structural controllability of multi-agent systems under switching communication topologies 
were derived. It was shown that the multi-agent system is structurally controllable if and only if 
the union graph Q is connected (single leader) or leader-follower connected (multi-leader). The 
graphic characterizations show a clear relationship between the controllability and interconnec- 
tion topologies and give us a foundation to design the optimal control effect for the switched 
multi-agent system. 

Some interesting remarks can be made on this result. First, it gives us a clear understanding 
on what are the necessary information exchanges among agents to make the group of agents 
behavior in a desirable way. Second, it provides us a guideline to design communication protocols 
among dynamical agents. It is required that the resulted communication topology among agents 
should somehow remain connected as time goes on, which is quite intuitive and reasonable. 
Third, it is possible to reduce communication load by disable certain linkages or make them on 
and off as long as the union graph is connected. Several interesting research questions arise from 
this scenario. For example, what is the optimal switching sequence of topologies in the sense 



March 1, 2013 



DRAFT 



19 

of minimum communication cost? How to co-design the switching topology path and control 
signals to achieve desirable configuration in an optimal way? We will investigate these questions 
in our future research. 
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